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We consider the ■pulse-code-modulation encoder that contains a delta 
modulator for analog-to-digital conversion, and a finite impulse response 
digital filter that suppresses high-frequency components of the delta modu- 
lation signal. A PCM word generator produces fixed-length binary code 
words by rounding and amplitude limiting the filter output samples. The 
quantizing noise of the resulting PCM signal has four components: delta 
modulation slope overload noise, filtered delta modulation granular noise, 
amplitude overload noise, and icord generator roundoff noise. We analyze 
the total quantizing noise for the case where the encoder input is a Gaussian 
random process and the digital filter impulse response is uniform (all 
coefficients equal). Such filters possess important implementation ad- 
vantages and appear to be near optimal with respect to signal-to-noise 
performance. Our analysis results in curves which show the relationship 
of signal-to-noise ratio to filter order, delta modulation sampling rate, 
and PCM word length. 

I. INTRODUCTION 

A new approach to digital encoding of continuous waveforms 
employs digital hardware to unite the economy of single-integration 
delta modulation (AM) with the efficiency of pulse code modulation 
(PCM). A finite impulse response digital filter suppresses the granular 
noise component of the AM representation of a continuous signal, and 
a word generator truncates the binary coded filter output to produce 
PCM code words of desired length. This encoding method controls the 
precision of the digital code by means of the AM speed and the filter 
order rather than with the resolution of the multibit quantizer that 
appears in conventional PCM encoders. This is a desirable substitution 
in view of current technology in which the cost of high-speed digital 
circuitry is rapidly declining. 

This method of AM/PCM encoding, which was originally proposed 
by Goodman, 1 has been applied to speech encoding by Freeny, et al., 2 - 3 
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and to video by Kaneko and Ishiguro. 4 Previous theoretical results 1 
focus on the filtering of the AM granular noise, but provide little 
insight into the important influence of AM slope overload and PCM 
amplitude overload on encoder design. Assuming the encoder input is 
a sample function of a Gaussian random process, the present paper 
analyzes the effects of the overload components of the quantizing 
distortion. It demonstrates that amplitude overload noise can be 
reduced if least significant bits of the filter output are truncated. 

We focus our attention on "uniform filter encoders," in which all 
filter impulse response coefficients are unity. Such encoders offer 
significant practical advantages, and they appear to be near optimal 
with respect to signal-to-noise performance. For such encoders, we 
show how performance varies with filter order, AM speed, and PCM 
word length, and we demonstrate the application of our results to the 
design of practical encoders. 

II. SIGNAL PROCESSING OPERATIONS 

The block diagram of Fig. 1 shows the operations involved in trans- 
forming the continuous signal y(t) to a uniformly quantized M-bit 
PCM sequence. Digital logic may be added to convert this sequence 
to a nonuniform PCM format. 5 The single-integration delta modulator 
of Fig. 2 converts y (t) to a sequence of pulses with amplitude + 1 or — 1 
at the rate /, = 1/t per second. The feedback loop is an ideal inte- 
grator with gain factor 5, while the up/down counter obtains a digital 
replica of x(t), the AM approximation signal. The output of the Nth- 
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Fig. 1 — Encoder block diagram. 



Am/pcm encoders 



185 



ANALOG 
V(t) + 



Kit) 



t SECOND 
CLOCK 



SLOPE - 



BINARY 



-GRANULAR 
NOISE 




%l k-r 



Fig. 2 — Delta modulator. 

order digital filter is a weighted sum of consecutive AM approximations 
to y(t). 

Although the filter outputs range over a discrete set, the number of 
possible filter outputs is unlimited because there is no" fundamental 
restriction on the amplitude range represented by a delta modulator. 
It follows that, with the PCM word length prespecified, an additional 
quantizing operation is required. This quantization is performed by 
the word generator which restricts to 2 M the number of possible coder 
output words. The word generator introduces amplitude overload and 
it may also add to the granular quantization error by rounding off 
least significant bits of the filter output. 

The filter and word generator are controlled by a clock which causes 
coder output words to be generated at the rate 2W per second, where 
W is the bandwidth of the analog input. Hence, the data rate of the 
coder is 2MW bits/second and the PCM sequence may be decoded as 
if it were produced by a conventional encoder consisting of a 1/2W- 
second sampler and a uniform quantizer with 2 M output levels. 



III. THE PCM QUANTIZATION LEVELS 

With the filter coefficients, g,, integers as in a practical realization, 
the filter output at t = kr is the integer 



N-l 

u k = L giWk-i 

t'-O 



(1) 



where [w,] is the sequence of counter outputs. Because Wj = Wj-i ± 1, 
the parity of the filter input alternates between even and odd at each 
AM sampling instant. It follows that if f,/2W, the ratio of AM sam- 
pling rate to PCM sampling rate, is an even integer, the parities of 
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w k , iVk-i, ■ ■ • , Wk-N+i are invariant at the PCM sampling instants. 
Hence, the parity of u k is the same at all PCM sampling instants. 
Because odd-parity filter outputs lead to an easily implemented word 
generator, we restrict our attention to encoders in which Wk and w* 
are both odd integers at the PCM sampling instants. The filter coeffi- 
cients of these encoders satisfy conditions, derived in the Appendix, 
which do not severely restrict the set of available filter transfer func- 
tions. The conditions do, however, preclude uniform filter encoders of 
orders 4, 8, 12, etc. 

If to is the encoder delay, the odd integer u k is a scaled approximation 
to y(kr — to). To determine the scaling factor, we observe that x(kr), 
the AM approximation to y(kr), is related to w k by x(kr) = 8ic k . 
Further, since the filter provides relatively distortionless gain over the 
signal bandwidth, it expands the amplitude scale of Wk by approxi- 
mately the amount of the dc gain, 

N-l 

I = E 9<. (2) 

Thus, (8/I)u k is an approximation to y(kr - t ) and, with u k ranging 
over odd integers, the signal levels represented by the input to the 
word generator are in the set 

8 8 8 8 

-' " 3 7' I' ? 3 7'-' (3) 

with quantizing step size 28/1. Because the scaling by 8/1 is approxi- 
mate, we admit an additional scale factor, 7, which brings the PCM 
representation optimally close to y(t) in the mean square sense. The 
actual step size of the filter output is therefore 

25 
d = jy. (4) 

In Section 7.5, we show that 7, which depends on </,-, is close to unity 
for encoders of practical interest. 

Figure 3 shows the mapping of the filter output into M-bit code 
words. To eliminate a information bits from the binary representa- 
tion of Uk, the word generator truncates the a + 1 least significant 
bits. (With Uk odd at PCM sampling instants, the least significant bit 
always has value one and hence conveys no information.) In the 
absence of amplitude overload, 

In*! ^ 2 M+a - 1 
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Fig. 3 — Word generator roundoff procedure. 



and the PCM code word consists of the M — 1 least significant bits 
of the truncated binary representation 1 of Uk and the sign bit. When 

\u h \ > 2*+° - 1, 

the transmitted code word is either the most positive or most negative 
M-b'it word. A decoder recovers the integer code words of Fig. 3 by 
appending a one and a zeros to the least significant end of the PCM 
word. 

With the truncation of each information bit, the step size increases 
by a factor 2 so that, with a information bits truncated, the PCM code 



t In Section V, we point out an advantage of the twos complement, binary format. 
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words represent signal levels in the set 

d do d d 

±2--,±3-2-- > ±5-2«-,-.-, ±(2- v - l)-2«- (5) 

2 2 2 Z 



with step size 



25 
d = 2 a d = 2" — t (6) 



and maximum amplitude (2 M — l)2 a 8y/I. 

IV. UNIFORM DIGITAL FILTERS 

The value of I, the dc gain of the digital filter, is crucial in determin- 
ing the character of the overall PCM quantizing noise. With the filter 
coefficients all integers, / may be regarded as a measure of coefficient 
quantization. A large value of / corresponds to fine quantization be- 
cause it allows considerable freedom in choosing g-,. To obtain a filter 
transfer function that approximates with arbitrary accuracy the opti- 
mum transfer function with respect to granular noise, 1 an arbitrarily 
high value of / is required. On the other hand, amplitude overload 
noise increases rapidly with / because the dynamic range of the 
encoder is nearly proportional to I~ l . 

The rapid increase in amplitude overload noise as a function of / 
leads us to focus our attention on the uniform filter, 

p<- 1; t-0, 1, ••-,#- 1, (7) 

for which I = N, resulting in the greatest dynamic range attainable 
with an iVth order filter with all coefficients of the same polarity. (We 
exclude from consideration filters with g, ■ = for one or more i.) 
Reference 1 suggests that, for high sampling rates, the coefficients of 
the optimum filter with respect to granular noise are nearly equal and 
that the difference in granular noise rejection between this optimum 
filter and the uniform filter is marginal. This observation suggests that 
encoders with uniform filters, because they minimize amplitude over- 
load noise and produce near minimal granular noise, are nearly optimal 
with respect to total quantizing noise. Further support for this specu- 
lation is given later. 

In the frequency domain, the uniform filter transfer function is 
sin (irNf/f,)/sin (irf/f,) and the filter rejects increasing amounts of 
AM granular noise as N increases. So long as f,/N is large relative to 
2W, the signal component of x(t) is undistorted by the filter; but, as 
f,/N approaches 2W, distortion of in-band signal components becomes 
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significant, and overall performance deteriorates with increasing N. 
Thus, if the advantages of very high-order filtering are sought, designs 
more sophisticated than eq. (7) are required. 

V. IMPLEMENTATION 

Besides possessing noise-rejection properties, uniform filters admit 
considerable hardware economies relative to other designs. With all 
coefficients unity, no multiplication is required, and each filter output 
is merely the sum of N successive counter levels. Therefore, one may 
implement the uniform filter as a resettable accumulator, thereby 
eliminating the delay line of Fig. 1, as well as the multipliers. To obtain 
a PCM sample, the coder sets the accumulator to the current level of 
the up/down counter and adds to the accumulator the next N — 1 
counter levels. 

Because the addition of N numbers is required only once for each 
PCM sample, and because JJ2W, the number of AM samples per PCM 
sample, is generally much greater than N, it is possible to time-share 
a single accumulator among many signal channels. With inputs pre- 
sented to the accumulator at the AM rate, the number of channels 
sharing a single accumulator may be as high as f,/2WN. Hence, in 
terms of hardware requirements, the filter order, N, determines time- 
sharing capacity rather than the number of circuits necessary to 
realize a single encoder. 

In addition to adding counter levels into an accumulator and 
truncating least significant bits of the sum, the encoder must detect 
amplitude overload and generate the most positive or most negative 
code word when the word generator is overloaded. 

It must also restore the proportionality of the counter level, w k , 
to the AM approximation, x(kr), after each instance of counter over- 
load. The wrap-around property of twos complement arithmetic 
ensures this proportionality whenever \x(kr)\ < (2 M+a — 1)5. On the 
other hand, a saturating counter would require special measures to 
restore tracking after each instance of counter overload. 

VI. ENCODER PERFORMANCE 

6.1 Figure of Merit and Design Specifications 

An ideal decoder of the encoder output sequence obtains y{t) ( defined 
in Section 7.1), a delayed, noisy approximation to the analog input 
y{t). We define the quantizing noise power of y{t) to be 

N T = E\lyy(t)-y{t-U)J\ (8) 
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Fig. 4 — Relationship of design objectives (Z n ,Z R ) to figure of merit (Z). 

where E denotes expectation, U is the encoder delay, and 7 is the 
mean-square optimum scaling factor. For each digital filter, PCM word 
length, and AM sampling rate there is a unique combination of values 
of 5, the AM step size, and a, the word generator parameter, that 
results in minimal N T - We choose as a figure of encoder merit the ratio 
of signal power to this minimum noise power/ 

z = *W -'■>]■> . (9) 

min Nt 



In the design of a practical encoder, typical specifications include a 
signal-to-noise ratio design goal, Z D , and a range, Zr, of input powers 
over which the actual signal-to-noise ratio must equal or exceed Z D . 
The practical significance of our figure of merit is found in the 
approximation 

Z « Z D + Z R (10) 



* Nt is a convex function of 5 and a. In our numerical work we have used simple 
search techniques to find min a ,j 2Vr. 
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where each quantity is measured in decibels. For example, an encoder 
for which Z = 55 dB will actually attain this signal-to-noise ratio for 
a single level of input power, and will maintain a signal-to-noise ratio 
of 35 dB or better over a range of 20 dB in signal power. 

Equation (10) is derived from Fig. 4, an approximation to the 
dependence of signal-to-noise ratio on input level. If {a/8) exceeds 
(o"/5) pt, the optimum ratio of rms input to AM step size, overload 
noise predominates in the distortion and the signal-to-noise ratio falls 
rapidly as a 2 increases. On the other hand, with (o-/5) < (o-/5) op t, 
granular noise predominates and, with 8 fixed, is essentially indepen- 
dent of a. Hence, the signal-to-noise ratio is proportional to a 2 in the 
granular region. 

If the ensemble of input power levels is log-normally distributed, as 
in models used for speech signals, 6 10 log (cr/5) 2 is a normal random 
variable, the mean value of which we denote by 10 log (<f/8) . Hence, 
the probability that the signal-to-noise ratio exceeds Zd is maximum 
when 8d, the design value of the step size, is chosen such that 

10 log (<r/8 D ) 2 = 10 log Or/5) V - \Z R . (11) 

That is, 10 log (<x/5 D ) 2 is the midpoint of the design range of length Zr. 

6.2 Pei-formance Characteristics 

Figure 5 shows a typical set of performance curves, computed 
according to the theory presented in Section VII. The curves pertain 
to 11-bit encoding of Gaussian signals having a truncated first-order 
Butterworth power spectrum, where the ratio of 3-dB frequency to 
cutoff frequency is 0.25. This type of process has been used to model 
band-limited speech. 7 The performance curves show the figure of 
merit, Z, of uniform filter encoders of various orders as a function of 
f,/2W, the AM sampling rate expressed as a multiple of the PCM rate. 

The choice of a specific encoder configuration represents a com- 
promise between the advantages of low AM speed and low filter order. 
The nature of this compromise is illustrated in Fig. 6, which shows 
combinations of AM speed and filter order that satisfy two quality 
objectives. The broken curves relate AM speed to the maximum filter 
order consistent with sharing the accumulator described in Section V 
among 24, 48, and 96 signal channels, respectively. All design points to 
the right of a broken line are permissible for the given number of multi- 
plexed channels. 
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Fig. 5— Performance characteristics, M = 1 1 bits, Butterworth spectrum. 



6.3 Dependence of Performance on Design Parameters 

Figure 5 demonstrates two types of variation of Z with /, : Z rising 
with a slope of 20 dB/decade, and Z flat or decreasing slowly with /,. 
The first type of behavior occurs when amplitude overload is negligible 
and slope overload controls the optimum AM step size. In this case, 
the optimum step size varies approximately as l/f„ and the decrease 
continues until amplitude overload becomes significant. When ampli- 
tude overload is the predominant overload noise, the optimum step 
size is essentially constant and the slightly negative slope of Z indicates 
that an increase in /, results in an increase in the granular noise corre- 
lation from sample to sample, leading to a greater proportion of the 
AM granular noise power in the passband of the filter. 

The flat portions of the curves represent transition regions to higher 
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Fig. 6 — Design alternatives derived from Fig. 5, M = 11 bits, Butter worth 
spectrum. 



values of a, at which the increased roundoff noise of the word generator 
is offset by improved immunity to amplitude overload. As /, increases 
indefinitely, Z approaches the maximum signal-to-noise ratio associated 
with uniform PCM encoding of Gaussian signals. 

In Figs. 7 and 8, we see that the shapes of the characteristic curves 
are essentially invariant with the number of bits in the PCM code. 
In Fig. 7, which pertains to 11-bit encoding of signals with a flat 
spectrum, amplitude overload effects occur at points that are approxi- 
mately 10 log (2 n /2 8 ) = 18 dB higher in signal-to-noise ratio and 
further to the right by the factor 2 u /2 8 in sampling rate, relative to the 
corresponding points in Fig. 8, which pertains to 8-bit encoding of the 
same input process. 

Figures 5, 7, and 8 also demonstrate the effect of filter order. When 
/, is quite low and amplitude overload is negligible, Z increases mono- 
tonically with N. However, the value of /, at which amplitude overload 
becomes significant decreases as N increases, and the earlier transitions 
from a = 0toa=l,a=l to a = 2, etc., lead to the crossovers. 

Figures 5 and 7 relate to the same PCM word length but different 
signal spectra. The principal difference between the two sets of curves 
is a scale change of the horizontal axis. In Fig. 5, the axis is shifted to 
the left relative to Fig. 7 by the factor 1.6, which is the ratio by which 
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Fig. 7 — Performance characteristics, M = 1 1 bits, uniform spectrum. 

the rms slope of signals having the uniform spectrum exceeds the rms 
slope of signals having the Butterworth spectrum. 



VII. QUANTIZING NOISE ANALYSIS 

7.1 Noise Components 

To reconstruct an analog signal from the sequence of word generator 

outputs, we first recover one of the integers shown in the ath column 

of Fig. 3 by appending a one and a zeros to the least significant end of 

each code word. We next multiply the sequence of integers by the 

nominal scale factor 8/1 and denote the resulting sequence by [#,}. 

Finally, we perform ideal interpolation of ( £,) to obtain the continuous 

waveform 

- sm2*W{t- j/2W) 

' W jtj 1 2xW(t-j/2W) 
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Fig. 8 — Performance characteristics, M = 8 bits, uniform spectrum. 

Our purpose, in this section, is to investigate the difference between 
y(t) and the encoder input, y(t), when this input is a sample function 
of a zero-mean stationary Gaussian random process. Our measure of 
distortion is the total quantizing noise power, N T , denned in eq. (8). 
Because y{t) is stationary, N T is independent of time, and in the sequel 
we omit time arguments and subscripts from the notation of signals 
when there is no risk of ambiguity. Although y in eq. (8) is a compli- 
cated function of signal statistics and encoder design parameters, the 
introduction of the preliminary scaling factor, 8/1, leads to 7 « 1 in 
situations of greatest interest. (See Section 7.5.) The other constant 
in eq. (8) is t , and we observe that if the filter coefficients have even 
symmetry (</, = gfr_i_<), the filter delay is 



t = (N - l)r/2, 
one-half the filter memory span. 



(13) 
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To derive N T as a function of the encoder design parameters, we 
recognize y as the sum of a signal term and four noise terms. We begin 
by writing 

0-=-(tt + n„) (14) 

where u is the filter output and n w represents the difference between 
the input and output of the word generator. In studying (8/I)u, the 
filtered AM signal, it is customary to identify granular and slope over- 
load components of the AM quantizing noise, in the manner indicated 
in Fig. 2. If wc rewrite eq. (1) as u - g * (x/8), with * denoting con- 
volution and x denoting the approximation signal in the delta modu- 
lator feedback loop, we obtain 

8 V 9 , ix rte\ 

-u=-*x = -*{y + n G + lis) Uo; 

where n G and n s are AM granular and slope overload noise, respectively. 
The distortion introduced by the word generator, (6//)n„, may 
itself be resolved into two components, namely, n A , which accounts for 
amplitude overload, and n R , which represents the roundoff effect. 
These observations lead us to a representation of the quantizing noise 
signal as the sum of four noise components : 



[7g ~l 7g 

— * (y + no) - y + y * n s + yn A + yn R . 



(16) 



The term in square brackets is the filtered granular noise, and the 
remaining terms are slope overload noise, amplitude overload noise, and 
word generator roundoff noise, respectively. In this paper we evaluate 
the expected square of eq. (16) by assuming that the expected product 
of each pair of terms is negligible relative to the sum of the two mean 
square values. Thus we express the total quantizing noise as the sum 
of four noise powers 

N T = N G + y*N s + y*N A + 7 2 #« (17) 

in which each term is the expected square of a term in eq. (16) . 

When the total quantizing noise is low, we are justified in approxi- 
mating the average cross products of eq. (16) by zero because: (i) 
granular noise and roundoff noise are zero during overload bursts ; (it) 
each type of overload occurs with low probability and the probability 
of their joint occurrence is negligible; and (in) we have found that 
\E(n n R )\ is many orders of magnitude lower than N G + Nr when 
M > 4. 
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7.2 AM Granular Noise and Slope Overload Noise 

Expanding the square of the term in brackets in eq. (16), we obtain 

N G = E(y*) - 2 - L gi R xu (ir - h) 

I i-0 



( 7 \ 2 N-l JV-1 
-) E Z gigiRUir ~ jr) (18) 
1/ i=o i=n 



in which the AM correlation functions, 

«.»(t) = EQ/(0a:(« + r)l R xx (t) = E£x(t)x(t + r)] 

are derived in Ref. 8, under the assumption that overload never occurs. 
To use the results of Ref. 8 and also account for overload, we should 
multiply N G in eq. (18) by the probability that overload is absent. For 
the applications that interest us, the probability is greater than 0.99, 
and we adopt eq. (18) as an approximation to No that overestimates 
the granular noise component of Nt by no more than one percent. In 
Section 7.4, we similarly overestimate Nr. 

To compute Ns, wo adopt the assumption of previous authors 7,9 that 
essentially all of the AM slope overload noise power is in the signal 
band of y(t) so that N s = E{L((j/I) * n.s] 2 } ~ E(n£). In our numerical 
analysis, we have followed Protonotarios, 9 who derives 2?(nf) as a 
function of 

S = ;K?F' (19) 

the ratio of the maximum slope of x(t) to the rms slope of y(t). For 
high values of S, N s is proportional to S~'° exp [— fjS 8 ]. 

7.3 Amplitude Overload Noise 

The maximum output of the word generator is 2 a (2 M — 1). Assum- 
ing there is no granular or slope overload noise during amplitude 
overload intervals, 

g 5 

n A = j*y --2*(2 W - 1); g * y > 2«(2" - 1)5 

g 5 

= j*y + -2 a (2 M - 1); g*y < - 2«{2 M - 1)8 

= 0; \g*y\ ^2«(2 itf - 1)8. (20) 

Because (g/I) * y is a sample function of a zero-mean Gaussian process 
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with variance 

I N-l N-l 

(TP - — E E gigjRvv(iT - jr), (21) 

/ ,=o y— o 

the mean square value of eq. (20) is 

/DO 
<r F (z - A) 2 exp(-§z 2 )dx 

- ^{(1 + A*) erfc (2-U) - {2/r)*A exp (-JA 1 )) (22) 

in which A is the amplitude overload factor, 

2"(2 M - 1)5 
A = -• (23) 

I<T F 

7.4 Word Generator Roundoff Noise 

With u the filter output and z(-) the mapping shown in Fig. 3, 

N R = d -El{z-uy~\. (24) 

Because u is an odd integer, we have the binary number representation 
of u > 0, 

00 

u = E o,2' + 1 

where 6j = or 1. The word generator truncates b a b a -i ■ ■ ■ &il from 
this representation and z is obtained by replacing these digits with 
10 • • • = 2 a . 
Hence 

z = L b,-2»" + 2" (25) 

and 

2 — u = 0; a = 

= 2*- 1 - E&.-2*'; oSl. (26) 

For w < the odd symmetry of Fig. 3 implies z(u) = — z{ — u). 
Hence z — u is an odd integer in [— (2 a — 1), 2 a — 1] and the ex- 
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pectation in eq. (24) is a weighted average of the integers 
l 2 , 3 2 , • • • , (2 a — l) 2 . From this observation, we immediately obtain 
the bounds 

5 2 8 2 

jrS^S-^--l)». (27) 

With a = 1, the bounds are equal and N R = 8 2 /P. 

For a > 1, we evaluate Nr only for coders with uniform digital 
filters. All odd integers are possible outputs of such filters. That is, 
Pr { u = In + 1 ) > for all n and, for low-noise encoding, this prob- 
ability is quite nearly constant over a set of 2 a_1 consecutive integers. 
When scaled to the amplitude range of y(t), such a set of filter outputs 
lies in an interval of length 

25 

— 2«" I 7 = d/2, (28) 

a small fraction of a (typically of the order of 4cr/2 M ). For M^ 5, 
the envelope of Pr { u = 2n + 1 } has approximately the Gaussian 
shape of the probability density of y(t) and a piecewise constant ap- 
proximation to this density over intervals of length d or less leads to 
highly accurate expressions for quantizing noise power. 10 

Over intervals of length d/2, (z — u) 2 takes on all the values l 2 , 
3 2 , • • • (2 a — l) 2 either in ascending or descending order. Hence, the 
piecewise constant approximation to Pr{u = 2n + 1} reduces the ex- 
pectation in eq. (24) to an unweighted average of these 2 a ~ 1 integers, 

b 2 2a_1 8 2 (4° - 1) 

V* = -2-<-» E (2i - D 2 = -— — • (29) 

■* i' = l 1 o 

Noting that eq. (6) admits the expression 

t 2 d 2 



7M- 



0'- 



4(4°) ' 

we summarize the results of this section as follows : 

y 2 N R = 0; a = 

d 2 
= — ; a = 1 

16 

d 2 
= — -(1— 4 a ); a^O, uniform filter encoders. (30) 
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The last line indicates that N R -» d?/12 as a -> co . This limit is the 
granular noise associated with instantaneous PCM encoding of samples 
ranging over the continuum. 

7.5 The Optimum Scale Factor 

To complete our quantizing noise analysis and establish the validity 
of prescaling the word generator output by 8/1, we show that 7, the 
additional scaling factor that brings the amplitude of y(t) optimally 
close to that of y(t) in the mean square sense, is nearly unity in designs 
of practical interest. Specifically, we derive the inequalities, 

(l-b)7o<7<7o (31) 

where b is of the order of magnitude of the noise-to-signal ratio and 

AT-l N-l 

£ E gigjRvviir ~ to) 

70 = ^=0 — (32) 

Z Z gigjRniir - jr) 

t=o i— 

Clearly as /„ — > °° , all of the covariances in eq. (32) approach a 2 and 
hence 70— > 1. In all of the numerical examples considered in Section 
VI, the sampling rates are so high that 70 is quite nearly unity. 
For example, all of the points plotted in Fig. 6 correspond to 
0.99 < 70 < 1.01. 

By definition, 7 is the value of c that minimizes 



E\_{cy - y) 2 ] = E [7y *{y + n G )-y + cn J J. 



(33) 



The expression in square brackets on the right side is identical to eq. 
(16) with c replacing 7 and cn replacing the last three terms. Because 
we have assumed the correlation of n and \_{cg/I) * (y + no) — y~] 
to be zero, we may rewrite 



E\_(cy - </) 2 ] = E |"y * (y + n G ) - y] + c*E(n ) . 



(34) 



Differentiating this equation with respect to c, and equating to 7 the 
value of c that causes the derivative to be zero, we obtain 
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7 = 



E\j * (V + n )J + E(nl) 



I N-l 

~ E giRz„(lT - to) 

1 1 = 

(35) 



I JV-l N-l 

- E E gigiRUir - jr) +Ns + N A + Nn 

1 i = > = 

Reference 8 demonstrates that, for low-noise encoding, the approxi- 
mations .ftxj, ~ /£,,„ and R xz ~ R uu + R ee [where Ree(-) is the auto- 
correlation function of the unfiltered granular quantizing noise] are ex- 
tremely precise. Thus eq. (35) becomes 

1 »-i 

- E giRyv(ir - to) 

-* = T^r^ - < 36 ) 

-I I gigjRUir - jr) + No + Ns + N A +N R 

1 t = > = 

where 

I N-l N-l 

No - — E E gigjRe,(iT - jr) 

1 i_0 >=0 

and is of the order of magnitude of iV^. 1 We now recognize that the 
first term in the denominator of eq. (36) is <rf [eq. (21)], the power of 
the filtered signal component of the AM approximation. If we divide 
numerator and denominator by this term (and substitute Et </■ for 7) 
we obtain 

where we have defined 

b = (No + N A + N s + N R )/ol (38) 

which is the order of magnitude of N t /<t 2 . Equation (31) follows 
immediately from eq. (37). 

VIII. SUMMARY AND CONCLUSION 

Section VII presents the analytical steps enabling us to compute 
the figure of merit, Z, of a AM/PCM encoder. The rationale for using 
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this figure of merit is presented in Section VI (Fig. 4) along with 
results for some special cases of interest (Figs. 5, 7, and 8). The ultimate 
utility of these results is that they enable the designer to determine 
tradeoffs between AM sampling speed and digital filter order for 
specified values of encoder quality (e.g., Fig. 6). 

We should reiterate the conditions assumed for the encoder in deriv- 
ing our results. First, we have assumed that the digital filter output is 
at odd parity at every PCM sampling instant. Aside from simplifying 
the roundoff noise analysis, this condition appears to correspond to the 
simplest possible implementation of the PCM word generator. The 
primary design constraint it imposes is the prohibition of digital filters 
of orders 4, 8, 12, etc. 

Second, we have assumed that the digital filter has uniform co- 
efficients. This condition makes a complete noise analysis relatively 
straightforward and also leads to a simple filter implementation. 
Furthermore, it corresponds to a robust design that appears to be 
near optimal in all cases of practical interest. Attempts to demonstrate 
the latter point quantitatively have foundered on the difficulty of 
assessing the roundoff noise power (N R ) when the filter coefficients are 
nonuniform. If we assume that, for any step size, d, the roundoff noise 



42 














40 












^a = 4 


10 














-i 
iju 










a=3 




m 














u 








/a = 2 






LU 




UPPER 










a 38 




BOUND (Z) 










z 














— 








MJNIFORM FILTER 






o 








PERFORMANCE (Z) 






H 














< 














■ 36 














ui 














W 














O 




/ /a = 1 










z 














o _ 




























-1 










M = 8 BITS 




< 

z 
o 










N - 11 STAGES 












UNIFORM 




I/) 










SPECTRUM 




32 




//a = 










30 




I 


I 


1 


1 


1 


2 C 





500 


1000 


?ooo 


4000 


8000 



NORMALIZED SAMPLING RATE (f s / 2 W) 

Fig. 9 — Uniform filter assessment. 



Am/pcm encoders 203 

power is nondecreasing with the number of bits truncated, we can 
derive an upper bound on Z. A comparison of this upper bound, Z, 
with the figure of merit resulting from uniform coefficients is shown in 
Fig. 9 for one case. Comparable results can be expected for other 
combinations of signal spectrum, PCM word length, and filter order. 



APPENDIX 

Odd-Parity Filter Outputs 

With the encoder delay equal to one-half the filter memory span 
[eq. (13)], we consider symmetric coefficient sets 

j7, = g N -i-i, i = 0, 1, • • ■ , i N — 1 ; N even 

(39) 
(ji = g N -i-i, i = 0, 1, • • , %(N - 3) ; N odd. 

Such coefficients give equal weight to counter levels that are equally 
advanced or retarded with respect to y(kr — t ), the input value 
estimated at t = kr. Equation (39), when combined with eq. (1), 
implies 

\N-l 

u k = T. gi[w k -i + Wk-w-D+il; N even (40) 

i-0 

JGV-3) 

Uk = gtw-i)Wk-i(N-i) + T. gi[wk-i + Wk-(N-i)+i]', N odd. (41) 

With the counter levels, id, alternating in parity, the two counter 
levels in square brackets in eq. (40) are of opposite parity because the 
difference in subscripts, N — 1 — 2z, is an odd number. Hence, their 
sum is odd. On the other hand, the two corresponding counter levels in 
eq. (41) have the same parity, and thus an even sum, because 
N — 1 — 2t is even with iV odd. These observations lead to the 
following necessary and sufficient conditions for Uk ranging over the 
set of odd integers : 

Condition A : With N even, Uk is odd if and only if there is an odd 
number of odd coefficients in the set go, Qx, — , Q\n-i- 

Condition B: With N odd, Uk is odd at a PCM sampling instant if 
and only if g^N-i) is odd and the low-speed clock is synchronized so 
that PCM sampling instants occur when w.'t_} ( Ar_i) is odd. This syn- 
chronization can be achieved if the ratio of AM sampling rate to PCM 
sampling rate is an even integer. 
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In uniform filter encoders, Condition A is always satisfied when 
N = 2, 6, 10, etc. It can never be satisfied with N = 4, 8, 12, etc. For 
Condition B to be satisfied, the encoder must be synchronized such 
that w k - N+ i (the first term entering the accumulator described in 
Section V) is odd when N = 1, 5, 9, etc; w k - N+ i must be even when 
N = 3,7, 11, etc. 
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